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Abstract 


In  the  design  of  optimal  control  systems,  emphasis  is  placed  on  the 
accuracy  of  the  system  mathematical  model.  If  certain  modeling 
parameters  deviate  from  their  assumed  nominal  values,  the  optimal 
control  may  not  produce  the  desired  output.  A  complete  theory  is  de¬ 
veloped  in  this  paper  for  the  practical  design  of  linear,  nominally 
equivalent  feedback  compensators  which  minimize  the  output  sensitivity 
to  system  parameter  variations.  An  example  is  presented  to  compare 
these  compensators  with  those  which  regulate  and  stabilize. 


l.C  INTRODUCTION 


Most  of  the  work  on  sensitivity  reduction 
in  optimal  control  systems  (reference  1J 
has  been  with  the  inclusion  of  sensitivity 
terms  in  the  original  cost  function.  This 
technique  trades  off  the  primary  design  ob¬ 
jectives  for  sensitively  reduction.  To 
achieve  the  latter,  however,  a  significant 
deviation  from  the  design  goals  is  usually 
required.  In  addition,  the  original  opti¬ 
mal  control  cannot  be  realized  when  the 
modal  parameters  ere  at  their  nonir.'tl 
values. 


2.1 


2.0  MINIMUM  SENSITIVE  CONTROL 
PROBLD!  STATEMENT 


The  soluticn  cf  an  optimal  control  problem 
over  the  time  interval  [0,T]  can  T>e  de¬ 
scribed  by  the  following  differential 
equation: 


J«C0) 


2nl 


(1) 


In  this  paper,  a  complete  theory  for  the 
practical  design  of  linear  feedback  compen¬ 
sators  which  minimize  output  sensitivity  is 
developed.  Feedback  is  used  as  a  second  de¬ 
gree  of  freedom  in  the  optimal  control  prob¬ 
lem  tc  generate  a  nominally  equivalent  con¬ 
trol  function.  This  function  is  determined 
by  minimizing  the  mean  square  and  final 
value  first  order  sensitivity  with  a  cor¬ 
responding  limitation  on  the  required  feed¬ 
back  effort.  Necessary  and  sufficient  condi¬ 
tions  are  developed  from  which  an  explicit 
noniterative  solution  is  obtained  for  the 
linear  feedback  gaij*  term.  A  comparison  ex¬ 
ample  is  presented  to  show  the  superior 
sensitivity  reduction  characteristics  of  the 
minimum  sensitive  gain  function  relative  to 
regulating  and  stabilizing  controls- 
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(2) 


whiefr  is  the  desired  optimal  trajectory. 
When  the  optimal  control  is  implemented  in 
the  actual  system,  variations  in  modeling 
parameters  &rj  *  3,-t^  may  result  in  the  out; 
put  x(t)  deviating  significantly  from  the 
desired  output  To  reduce  the  output 

errors  caused  by  parameter  variations,  a 
nominally  equivalent  feedback  control  func¬ 
tion  is  defined  us  follows: 


u(t,x)  «  Uj(t)  ♦  K(t)x(t) 


(3) 


where  JC(t}  is  an  (r  x  n)  matrix  of  time 
functions  and  Uj(t)  is  determined  such  that 

«(*»*„>  -  (4) 

The  corresponding  closed  loop  system  is 
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where  x,  u  and  ^  are  of  dimensions  n,  r  and 
m  respectively  and  the  subscript  n  repre- 
.  sents  rcminal  or  design  values.  The  func¬ 
tion  f  (« )  is  assumed  to  be  continuous  in  t 
and  cl  WRT  x,  u  and  n.  The  solution  of  (1) 
is  given  by: 


m 


x-  i(t »£.“(*»£)•£> i  £t°)  *  2ni  0>) 
where  £  is  the  actual  parameter  vector.  As* 
suaing  that  initial  condition  errors  are 
accounted  for  in  un(t),  the  problem  is  to 
determineK(t)  such  that,  for  small  vari¬ 
ations  Aii  from  the  nominal  parameter  £n, 
the  actual  trajectory  x(t)  remains  close  to 
xft)  over  the  original  optimization  in- 
terval.  It  is  assumed  that  n  is  known  to 
within  a  scalar  constant, i. e. ,  n  «  n 
where  n#  is  an  unknown  magnitude  operating 
through  a  known  di-ection  ji_.  From  equations 
(3)  and  (5),  the  first  order  sensitivity 
vector  s(t)  relative  to  na  is  described  by 

s  »  A(t)£  ♦  B(t)K(t)s  ♦  £(t);  *(0)-^  (6) 

where  A,  B  and  £  represent  the  partial  de¬ 
rivatives  of  (5)  WIT  x,u(*)  and  respec-  . 
tively  evaluated  along  the  nominal.  The 
initial  value  of  the  sensitivity  vector  ^ 
will  normally  be  zero  since  the  parameter 
will  usually  not  affect  the  initial  state 

2nr 

The  sensitivity  cost  function  is  defined  as 
follows.  Two  measures  of  output  sensitivity 
arc 

mean  square  •  (1/2) /T  sT<jsdt 
o 

final  value  -  {l/2)sT{T)0s(T) 
where  Q  and  D  are  positive  semi- definite 
matrices  which  are  continuous  in  time.  The 
system  error  is  limited  by  restricting  the 
amount  of  feedback  K£t)x(*)  or  equivalently 
£(t)x.(t).  This  restriction  can  be  included 
in  the  cost  by  the  addition  of 

:  F,  .  ^  ^ViM14* 

where  *ij  >  0  and  continuous  in  time  ¥i,j 
This  restricts  each  state  feedback  compon¬ 
ent  of  the  control.  The  function  Fj  can  be 
combined  with  the  output  sensitivity  meas¬ 
ures  to  ~icid  the  following  cost  functional 
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J(K)  -  (1/2)sT(T)Ds(T)  ♦  {1/2)/T{sTQs 

o 

♦  r  r  2  2  (7) 

i'l  j'iVijsjIdt 

which  effectively  trades  off  the  cost  of 
feedback  for  reductions  in  output  sensitiv¬ 
ity.  The  problem  is  thus  to  determine  K(t) 
such  that  (7)  is  minimized  subject  to  (6). 

2.2  NECESSARY  AND  SUFFICIENT  CONDITIONS 

Necessary -conditions  for  this  problem  can 
be  obtained  from  straightforward  applica¬ 
tion  of  variational  methods  given  in  [2]. 
The  Hamiltonian  is  defined  as  follows: 

-  4  iV  -  jfjViK 

♦J>T  [As  ♦  BKs  <  £) .  (g) 

Using  this,  the  optimal  gain  components 
are  given  by 

■  rr 

Rij*j  4-1 

with  canonical  equations 

£  -  “AT£  ♦  Qs;  £(T)  -  -Ds(T)  (10) 
and  .  _ 

s.  •  As  ♦  BV3I£  ♦  £;  s(o)  *  0  (11) 

where  tfce  (r  x  r)  matrix  V  is  defined  by 


(i-I  R  t«y 

ai  .12) 

0  i*y 

The  canonical  equations  are  time  invariant 
whenever  the  sensitivity  equations  and  cost 
matrices  are  independent  of  time.  The  line¬ 
arity  therefore  «.llews  a  closed  form  solu¬ 
tion  for  the  gain  terms  given  by  (9) >  Note 
that  since  «  0  any  value  of  IC{0)  will 
satisfy  the  optimality  conditions.  In  prac¬ 
tise,  however,  an  initial  bound  must  be 
determined  for  K(t).  The  Legendre  condj'riia 
is  obtained  from  (§)  as 


-  -RijSj2  aQ 

-  0 


Th*  Ifeierstrass  necessary  condition  is  im¬ 
plied  by (13)  when  the  extremal  is  non* 
singular  (reference  [2]}.  Sufficient  condi¬ 
tions  are  defined  by  the  following  theorem: 
Theoren  1:  The  gain  Matrix  K(t)  given  by 
(9),  (10)  and  (11)  exists  on  (0,T]  as  a 
ainirua  of  (7)  subject  to  (6)  if 


3.1  NECESSARY  AND  SUFFICIENT  CONDITIONS 

Exaaination  of  (9)  and  (14)  reveals  that 
singularities  in  the  optimal  gain  are  syn- 
onyaous  with  singular  cxtreaals.  The  cost 
function  (7)  will  therefore  be  Modified  to 
include  a  penalty  tera  for  large  feedback 
gains  as  follows: 


(14) 


*j|2(t)>0  Vte  (0,T] 

where  Sj(t)  is  the  jtB  coaponent  of  the 
solution  to  (6). 

Proof:  Froa  (13)  and  (14),  reference  (2] 
indicatos  that  sufficient  conditions  are 
satisfied  if  there  are  no  conjugate  points. 
Since  the  Matrices  D,  Q  and  R  are  positive 
seal-definite,  it  can  be  shown  that  no  con¬ 
jugate  points  exist.  This  cospletes  the 
proof. 

Froa  the  above  theoren,  the  existence  of 
the  alniaua;  sensitive  gain  is  determined 
aainly  by  (14)  which  is  a  somewhat  strong 
condition  and  definitely  not  satisfied  for 
arbitrary  cost  parameters  D,  Q  and  R  in 
(7)  and  arbitrary  functions  g(t)  in  (11).- 
This  is,  however,  the  price  of  achieving 
linearity^ of  the  canonical  equations  (10) 
and  (11).  For  a  given  systea,  cost  function 
and  noainal  trajectory,  these  equations  can 
easily  be  solved  to  deteraine  if  (14)  is 
satisfied.  If  not,  the  nonsihgular  approxi¬ 
mate  problem  formulated  in  the  next  section 
can  be  employed  to  obtain  the  optimal  gain. 

3.3  A  NONSINGULAR  SENSITIVITY  PROBLEM 


J(K)  -  JsT(T)Ds(T)  ♦  |  /T[sTQS  ♦  G]dt 

with  r  n  (IS) 

G  -  £  ECRii*ii2s?  ♦ 

i*l  j-1  1J  1J  3  XJ 


and  Ejj>0  Vi,j.  The  Haailtonian  for  the 
problea  of  ainiaixing  (IS)  subject*  to  (6)  is 


Hl(t,s,JC,p)  sT(fs  -  G  *  £T[As  ♦  BKs  ♦  gj. 


(16) 


Using  this,  the  optimal  gain  components  are 
given  by 


ij 


Rij*j  *  *•! 


n 

!,ptBti 


(17) 


with  canonical  equations 

iT. 


2  *  **2  ♦  Q*  ♦  £(T)  *»  -Ds(T)  (18) 

and 


s  »  As  ♦  B4(s)B*£  ♦  s(o)  -  0 


(1») 


where  the  components  of  a  are  defined  by 


T  Bii5i  I n  1* 

-  -  ?  - - •{  z  p,B.  -  (20) 

3  i-ltRijsj2  ♦  Eijl2t-1  I 


i)’j  “ij J 
and  the  (r  x  r)  matrix  Z  is  defined  by 


The  results  of  the  previous  section  indi¬ 
cate  that  singular  solutions  of  the  Minimum 
sensitivity  problea  are  the  major  cause  for 
failure  of  the  existence  conditions.  The 
problea  will  be  reformulated  in  this  sec* 
tioa  such  that  ail  extremals  are  nonsingu- 
laf.  As  a  consequence,  the  canonical  equa¬ 
tions  become  nonlinear  and  aust  be  solved 
be  approximation  or  iterative  techniques. 


ty 


s»j 


.•X  «„sj  .  E„ 


t-y 


(21) 


v  0 


The  canonical  equations  are  thus  nonlinear 
in  s.  and  j>.  The  Legendre  condition  is  ob¬ 
tained  froa  (1C) 


■(Rij*j  *  Eij5<  0  imt»  i** 

0  otherwise. 


(22) 
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The  Weierstrass  necessary  condition  is  im¬ 
plied  by  (22)  since  the  extremal  is  non¬ 
singular. 

The  existence  of  the  optimal  gain  can  bn 
directly  proven  using  Theorem  5  of  (3]. 
With  some  manipulation,  all  required  hy¬ 
potheses  can  be  shown  to  apply.  The  most 
difficult  is  the  determination  of  the  con¬ 
stant  C  foT  the  system  and  cost  inequali¬ 
ties.  This  can  easily  be  obtained  if  the 


*  *  t  *?Q,T] 
is  added  to  the  cost  J(K),  noting  that  the 
minimizing  gain  will  be  unaltered.  Cesari's 
Theorem  is  also  applicable  to  the  vector 
case  when  -  0,¥i,j.  In  general  R^>0 
for  some  i,j  and  then  the  theorem  cannot  be 
applied  since  the  gain  and  state  tei-ms  are 
not  functionally  separable.  It  is  probable, 
however,  that  a  slight  modification  can  be 
made  to  the  theorem  to  prove  existence  for 
the  general  case. 

3.2  SOLUTION  TECHNIQUES 

Since  the  canonical  equations  (18)  end  (19) 
are  nonlinear,  they  must  be  splved  either 
by  iteration  (gradient)  or  approximation 
techniques.  If  it  is  assumed  that  E- ^  is 
small  Vi,j  and  that  the  sensitivity- tens  in 
the  cost  have  sufficient  weight  such  that* 
£(t)  is  smalls  then  (IS)  and  (19)  can  be 
approximated  by  a  set  of  linear  equations. 
These  assumptions  result  in  *(• )  — 0  over 
IO,T].  Since  Eij>  0  ¥i,j  and  s(0)  »  0,  121) 
indicates  that  2(0, E)  ■  0.  The  sensitivity 
equation  (19)  therefore  initially  runs  open 
loop.  As  the  magnitude  of  s(t)  increases, 
the  matrix  Z(s,E)  approaches  V  for  small 
E^j.  Equations  (IE)  and  (29)  will  thus  be 
approximated  as  follows: 

£  «  -AT£  ♦  Qs;  £(T)  •  -Ds(T)  (23) 

*1  *  »0*tST. 

T  (2«) 

*2  "  A-2  *  BV®  V*  ;»2 (Tj)"*!  (Tj)  -.TjCttT 


where  Tj€  (0,T)  is  a  design  parameter  and 
/  5,(t)  OUST. 

I  s2(t)  Tj<tST 

Equations  (23)  -  (25)  can  be  explicitly 
solved  as  a  coupled  system.  The  optimal  gain 
K(t)  is- then  determined  by  (17). 

The  relationship  between  the  approximate 
solution  given  above  and  that  of  the  singular 
problem  described  in  Section  2.0  is  as  fol¬ 
lows.  The  approximation  effectively  reduces 
the  time  interval  of  optimization  and,  in 
doing  so,  generates  an  initial  sensitivity 
i  vector  consistent  with  £(t).  The  problem  re¬ 
sulting  from  some  components  of  s(t)  approach¬ 
ing  zero  on  (T^.Tj  still  remains,  although 
this  in  part  dictates  the  choice  of  T,.  When 
this  occurs,  the  approximation  of  2  by  V  on 
(Tj,T]  is  no  longer  valid.  The  choice  of  Tj 
is  further  complicated  by  the  fact  that  the 
desired  output  sensitivity  may  not  be  at¬ 
tained  if  Tj  is  too  large.  When  this  approxi¬ 
mation  cannot  be  used,  recourse  must  be  made 
to  iteration  techniques. 

4.0  COMPARISON  EXAMPLE 

The  question  examined  in  this  section  is 
how  much  better  does  the  minimum  sensitive 
(MS)  gain  perform  relative  to  regulator  (RG) 
pnd  stabilizing  (ST)  gains?  A  first  order 
example  will  be  described  below. 

Let  the  original  design  system  (nominal)  be 
given  by 

*  *  *n  x  *  un  ;  *  10  (*•) 

where  *n  "  1  and  uR(t)  is  determined  from 

min  1  1 

u  7  /0(x2  *  . 2u2)dt  (27) 

From  Section  2.0,  the  feedback  compensator 
is  given  by 

u(t)  -  un(t)  ♦  k(t)(y(t)  -  xn(t)]  (28; 

where  xn  is  the  optimal  solution  of  (26). 

The  actual  (Teal  world)*  system  is  repre¬ 
sented-  by 
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xjj-M 

T'tm 

m 


I-  I: 


y  »  2.2y  *  u(t)  ;  y(0)  -  10  (29) 

where  the  parameter  was  varied  20  percent 
in  the  unstable  direction.  Two  measures  of 
system  error  are 

1 

Mean  Square  -  JQ  (y~xn)2dt  (30) 

Final  Value  -  |y(l)-xn(l)|  . 

The  cost  of  using  feedback  is  measured  by 

Feedback  Cost  -  /  1{u-un)2dt  .  (3!) 

o 

Note  that  if  (29)  is  run  open  loop  (k(t)*0) 
then  u*u0  and  no  cost  penalty  is  incurred. 

The  MS  compensator  is  determined  as  a  solu¬ 
tion  to  the  following  problem 

■*n[|ds2(l)  ♦  \  ./(qs2  ♦  k*s2)dtj  (32) 
subject  to 

s  -  ans  ♦  is  ♦  xn(t)  ;  s(0)  »  0  (33) 

which  corresponds  to  that  posed  in  Section 
2.0.  The  regulator  gain  can  also  be  ob¬ 
tained  from  (32)  and  (33)  but  with  *n(t)"0 
uid  s (0)i*0.  For  the  first  order  case,  the 
stabilizing  gain  is  a  negative  constant. 

The  comparison  curves  for  the  minimum  sensi¬ 
tive,  regulator  and  stabilizing  gains  are 
shown  in  Figures  1  and  2.  For  this  example, 
a  suitable  goal  for  error  reduction  with 
feedback  was  taken  as  10  percent  of  the 
open  loop  error.  To  achieve  this  reduction, 
the  figures  indicate  that  the  minimum  sensi¬ 
tive  gain  requires  at  least  30  percent  less 
feedback  effort  than  the  regulator  and 
stabilizing  gains. 

S.Q  CONCLUSIONS 

The  parameter  variation  problem  in  optimal 
control  systems  has  been  solved  by  using 
feedback  as  a  second  degree  r»f  freedom  in 
the  optimltition  problem  to  minimize  output 
sensitivity.  Necessary  and  sufficient  con¬ 
ditions  were  obtained  for  the  minimizing 
gain  function.  In  addition,  an  example  w«s 
presented  which  indicated  that  the  mini¬ 
mum  sensitive  gain  offered  a  significant 


improvement  over  regulator  and  stabilizing 
gains  when  parameter  variati<<ns  occurred. 
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